LEXINGTON 


I.  Introduction 


In  his  1956  paper^,  Moser  mentions  a lottery  puzzle 

(2) 

posed  by  Cayley  in  1875v  . Moser  discusses  a formalized 

game  in  optimal  stopping,  closely  related  to  Cayley's  puzzle, 
and  supplies  a solution. 

In  Section  II  of  this  paper,  we  describe  Moser's  Game 
and  repeat  its  solution,  following,  in  the  main,  the  lucid 
treatment  of  Howard^  1 . In  Section  III  we  introduce  a 
generalization  of  the  game  --  an  extension  which  we  believe 
to  be  novel  --  and  give  its  solution.  Section  IV  briefly 
discusses  the  applicability  of  the  extended  problem  to  matters 
involving  the  allocation  of  limited  resources. 


II.  Moser's  Game 

The  problem  under  discussion  may  be  posed  in  the  form 


of  a game  against  Nature: 

A player  with  a marker  observes  repeated  draws 
of  a random  sample  from  a known  probability  distri- 
bution on  the  real  numbers.  Upon  observing  the 
magnitude,  x,  of  a draw,  he  may  choose  to  tag  (T) 
that  draw  with  his  marker:  should  he  do  so,  the 


* 


game  is  over  and  its  value  is  x.  Should  he  not 


A discussion  of  Moser's  Game,  under  a variety  of 
is  found  in  many  treatises  on  Dynamic  Programming 
Optimal  Stopping  Theory. 


1 


' '.'Ifi  Seaton 

" • faction 


names 

or 

□ 

PY 



BloWS' 
0«!  „ 

’"Wiry  gooes 

_ • v.1>or  SPECIAL 

h 

j 

J 


r 


□ □ 


tag  (T)  that  draw,  it  is  discarded  and  another  draw 
made  and  offered  to  him.  At  the  beginning  of  the 
game  he  knows  that  he  may  observe  as  many  as  s 
draws  if  he  chooses  to  do  so. 

What  stopping  strategy  ought  he  to  adopt  to 
maximize  the  value  of  the  game?  I.e.,  how  shall 
he  decide  when  to  tag  a draw? 

Howard's  formulation  of  the  solution  (with  notational 
changes)  is  followed  below,  with  some  simplification.  Let: 
s = No.  of  remaining  choices  or  draws  (or  stages) . 
t(s),  or  t,  = Threshold  for  stopping  at  Stage  s. 

I.e.,  if  the  draw  at  Stage  s exceeds  t,  the 
player  will  tag  it;  else,  he  will  pass  it  and 
go  to  Stage  (s-1) . 

v(s)  = The  expected  value  of  the  game  when  the  player 

is  in  Stage  s and  is  using  a general  tagging  strategy. 
v*(s)  = The  expected  value  of  being  in  Stage  s,  given 

that  the  player  utilizes  an  optimal  tagging  strategy. 
The  player  will  tag  a draw  if  it  is  sufficiently  large 
in  magnitude,  in  the  expectation  that  none  of  the  limited 
number  of  future  draws  will  be  larger.  Thus,  a tagging 
strategy  is  simply  a sequence  of  thresholds,  one  for  each 
stage.  The  player  compares  the  draw  at  a stage  with  the 
appropriate  threshold  and  tags  or  not  according  as  the 
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draws  exceeds  or  fall  short  of  the  threshold.  Then  the 


value  of  the  game  is  the  weighted  sum  of  the  values  which 
are  expected  to  result  from  tagging  or  from  continuing: 

v(s)  = Pr (T | t ) <Value|T,t>  + Pr (7 | t) v (s- 1)  (1) 

Now,  the  probability  of  tagging  is  the  probability  that 
the  draw,  x,  exceed  the  threshold: 

Pr  (T  1 1)  = Pr  (x  > t) 

Of  course: 

Pr  (T 1 1)  = 1 - Pr  (x  > t) 

The  value  of  the  halted  game  is  the  expected  value  of  x, 
given  that  it  exceeds  the  threshold: 

<Value|T,t>  = E(x|x  > t) 


\ 
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V*  ( s ) = m*x(4(l-t2)  + tv*  ( s - 1 ) } (4) 


By  differentiating  the  terms  within  brackets  with  respect  to 
t(s),  we  find  that  the  optimal  threshold  is  given  by: 
t*(s)  = t*  = v* ( s - 1 ) 

I.e.,  the  best  threshold  at  a stage  equals  the  value  of  the 
game  at  the  subsequent  stage.  (Quite  reasonable:  if  the 
current  draw  promises  to  be  better  than  the  value  of  the 
residual  game,  then  tag  the  draw;  otherwise,  continue.) 
Substituting  this  into  Eq(4): 


v*(s)  = h{l  + t*2(s)} 

= h(l  + V*2(s-1)}  (5) 

Eq ( 5)  is  a recursion  formula  for  the  value  of  the  game 
at  any  stage  in  terms  of  the  values  at  later  stages.  To  ini- 
tiate the  recursion  we  require,  as  a given  condition  to  the 
problem,  the  value  v*(0)  --  how  much  the  game  is  worth  if  the 
player  runs  out  of  draws  before  applying  his  marker.  The 
most  interesting  case  is  v*(0)  = 0,  and  we  shall  invariably 
assume  this  to  hold.  (This  implies  that  the  game  has  a null 
value  if  the  player  never  tags  a draw. ) 

Table  1 (based  on  Howard,  but  derived  independently) 
shows  v*(s)  for  the  first  30  values  of  s.  The  value  of  the 
game  approaches  1 asymptotically  for  increasing  s,  as  one 
might  expect  from  the  nature  of  the  game  and  the  form  of  Eq(5). 


TABLE  1 


OPTIMUM  VALUES  OF  MOSER’S  GAME, 

DRAWING  FROM  UNIFORM  DISTRIBUTION  (AFTER  HOWARDf3)) 


S VALOE 

0.5000 
0.6250 
0.6953 
0.7417 
5 0.7751 

0.8004 

0.8203 

0.8364 

0.8498 

10  0.8611 

0.8707 
0.8791 
0.8864 
0.8929 
15  0.8986 

0.9037 
0.9084 
0.9126 
0.9164 
20  0.9199 

0.9231 
0.926  1 
0.9288 
0.9313 
25  0.9337 

0.9359 
0.9379 
0.9399 
0.9417 
30  0.9434 
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General  Distribution 


If,  during  the  game,  the  drawings  are  made,  not  from  a 
uniform  distribution,  but  rather  from  one  with  a probability 
density,  f(*)>  it  can  readily  be  shown  that  the  recursion 
formula  for  v*(s)  takes  the  form: 

.t* 

f(z)  dz  (6) 

OO 

by  differentiating  the  r.h.s.  of  Eq(6)  with  respect  to  t* 
and  equating  the  result  to  0,  we  find  that  the  optimal 
threshold  again  obeys  the  relation: 

t*(s)  = v*(s-l)  (7) 

Numerical  problems  may  be  encountered  if  the  functions, 
f (z)  and  zf(z),  are  not  integrable  in  closed  form. 

III.  Generalization  of  Moser's  Game 

We  generalize  Moser's  Game  by  giving  the  player,  not 
one,  but  n markers.  As  before,  he  has  s draws  and  may  tag 
a draw  or  let  it  pass;  if  he  tags  it  and  if  draws  and  markers 
remain,  the  game  resumes.  At  the  end,  the  value  of  the  game 
is  the  sum  of  the  tagged  draws.  We  write: 

v (s)  = Expected  value  of  a game  which  is  in  Stage  s 
with  n markers  remaining. 

tn(s),  or  t = Threshold  used  in  Stage  s with  n markers. 
Then  we  may  write  an  equation  analogous  to  Eq(l): 


/*  OO 

v* (s)  = / zf (z)  dz  + v*(s-l) 
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v (s)  = Pr (T I t) {<Value  T,t,n>  + v .(s-1)) 
n ' 1 n-1 

+ { 1-Pr (T 1 1) } vn (s- 1)  (8) 

Eq (8)  expresses  the  fact  that  the  value,  vn(s),  is  the 
weighted  sum  of  the  values  of  two  exclusive  alternatives: 

i.  Tagging  the  current  draw,  which  accrues  the  value 
increment,  <Value | T , t ,n> , and  leaves  the  player 
with  the  value  of  the  residual  game,  viz  , 
v . (s - 1 ) 

ii.  Passing  the  current  draw,  which  leaves  the  player 
with  a game  of  value,  vn(s-l) 

By  manipulations  similar  to  those  in  Section  IT,  we  find: 
v*n(s)  = m^X  [Pr (T 1 1 ) { <Value  T,t,n>  + v*n  ^(s-l)} 

+ (l-Pr(T|t)}v*n(s-l)]  (9) 

Uniform  Distribution 

Once  again,  matters  simplify  if  the  drawings  arise  from 
a uniform  distribution  over  (0,1).  Eq(9)  becomes: 

v*n(s)  = m*x{Js(l-t2)  + (l-t)vVl(s-l)  + tv*n(s-l)>  (10) 

By  differentiating  within  the  brackets,  the  optimum  threshold 
is  found  to  be: 

t*  (s)  = v*  (s-1)  - v*  . (s-1)  (11) 

n'--'  nv^  n-1'  K ’ 

whence : 

v*n(s)  -■*[!♦  {v*n(s-l)-v.n.l(s-l)}2]  . v«n.j(s-l)  (12) 
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This  last  equation  may  be  more  suggestively  written  as: 

v*n(s)  = hu  * t*2n(s)}  + v*„_1  (s-1)  (13) 

to  show  its  parallelism  with  Eq(5). 

Eqs(ll)  and  (12)  provide  a recurrence  relation  from 
which  v*n(s)  can  be  determined,  knowing  the  values  of  the 
game  for  fewer  markers  and  fewer  draws.  As  before,  initial 
conditions  must  be  supplied,  and  we  take  v*^(0)  = v*?(0)  = 

...  = v*n(0)  = 0,  which  assigns  a null  value  to  any  game  in 
which  the  player  never  tags  a draw. 

Table  2 lists  values  of  v*n(s)  for  n from  2 to  9,  and 
for  the  first  30  values  of  s.  The  corresponding  thresholds 
are  shown  as  well.  The  asymptotic  value  of  v*n(s)  is,  of 
course,  n,  the  approach  to  the  limit  becoming  slower  with 
increasing  n.  For  the  first  n values  of  a game  in  which 
there  are  s choices,  the  incremental  value  of  the  game  is 
h per  additional  stage;  this  reflects  the  fact  that,  whenever 
the  player  has  as  many  markers  left  as  choices,  he  tags 
each  draw  regardless  of  its  magnitude,  and  gains  an  average 
of  h in  value  each  time.  Only  when  there  are  more  draws 
than  markers  left  in  a game  does  the  player  have  an  effective 
choice  of  tagging  or  passing. 

General  Distribution 

For  a general  density  function,  f(*)»  for  the  draws,  the 
optimal  threshold  is  still  given  by  Eq(ll),  and  the  recursion 
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relation  for  the  value  of  a game  is: 


/*  CO  /*  00 

fcn  (s)  = J * zf(z)  dz  + v*n-l(s'1)  /*f(z)  d2 

t*  /*t*  '/t* 

J -OO 


+ v*n(s-l) 


f ( z)  dz 


(14) 


The  numerical  problems  which  might  be  encountered  are  similar 
to  those  for  the  unextended  game. 


IV.  Discussion 

Moser's  Game  and  its  generalization  are  encountered  in 
some  applications  where  a limited  number  of  resources  (’markers') 
are  to  be  allocated  against  selected  realizations  of  a quan- 
tity of  recurring  opportunities  ('draws').  The  particular 
application  of  interest  to  the  writer,  which  drew  his  atten- 
tion to  this  game,  was  this: 

A defense  commander  controls  a finite  number  (n) 
of  weapons.  These  are  to  be  expended  on  an  indi- 
vidual basis  against  selected  members  of  an  at- 
tacking force  (of  which  there  are  s _>  n units). 

The  attackers  come  into  range  one  after  the  other 
and  the  commander  must  decide,  from  an  observed 
score  on  each  unit  --  higher  scores  being  cor- 
related with  more  dangerous  attackers  --,  which 
n units  to  intercept  and  which,  perforce,  to  pass. 

When  not  all  attacking  units  can  be  engaged,  and  when 
the  attackers  must  be  dealt  with  on  a one-by-one  basis,  the 
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TABLE  2 

VALUES  OF  GENERALIZED  MOSER'S  GAME 
DRAWING  FROM  UNIFORM  DISTRIBUTION 


N = 2 N = 3 


s 

VALUE 

THRESHOLD 

S 

VALUE 

THPESHC ID 

J.530'3 

0.0 

0.  5 0 00 

0.  0 

1. 0000 

0.  0 

1 . 0 J 0 3 

0.0 

1.  1953 

0. 3750 

1.  5 0 C 0 

O.C 

1.  3203 

C. 5000 

1.7417 

0.3047 

5 

1.  4091 

3. 5786 

5 

1.909  1 

0. 4214 

1.  476  1 

0.  6340 

2.  0 34  1 

C.C'J3  3 

1.5297 

0. 6757 

2.  1318 

0 . 55  p 0 

1.  5712 

0.7084 

2.2105 

0. 6031 

1.6064 

0. 7347 

2.  2756 

0.6353 

10 

1.  6 360 

0.7565 

10 

2.  3303 

0.66  92 

1.6613 

0.7749 

2.  3 7 7 0 

C.6943 

1.6933 

0.  7906 

2.  4 174 

0.7157 

1.7024 

0. 8042 

2. 4528 

0.734? 

1.7  194 

0.9160 

2.  4839 

C.  7503 

15 

1.  7344 

0.9265 

15 

2.5116 

3.7646 

1.7479 

0. 8358 

2.  5365 

0.7772 

1.  7600 

0.9441 

2.  5588 

0. 7e°6 

1.7710 

0. 9517 

2.5791 

0.7988 

1.  7 8 1 0 

0. 8585 

2. 5975 

0.9050 

20 

1.7902 

0.8647 

20 

2.6143 

0.8164 

1.7986 

0.8703 

2.  6256 

C.6241 

1.  8064 

0. 8755 

2.  6440 

0.8312 

1.8135 

0.8903 

2.  6572 

0. e377 

1.  8202 

0.  8647 

2.6694 

0. 8437 

25 

1.8263 

0.8888 

25 

2.6908 

0. 8493 

1.  8 321 

0. 6927 

2.6914 

0.8545 

1.  8375 

0.8962 

2.7013 

0. 8593 

1.8425 

0. 8996 

2.7106 

0.6638 

1.  8473 

0.9027 

2.7193 

0.8680 

30 

1.8517 

0.9056 

30 

2.  7275 

0.  8720 
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TABLE  2 
(Continued) 


s 

VALUE 

THRESHOLD 

S 

VALUE 

THRESHOLD 

C. 5000 

0.0 

0.5000 

0.0 

1.0000 

0.0 

1.  0000 

0.  0 

1.5000 

0.0 

1.5CC0 

0.0 

2.0000 

0.0 

2.0000 

0.0 

5 

2.2751 

0.2593 

5 

2.5000 

0.0 

2.  4761 

0.3660 

2.8004 

0.2249 

2.6318 

0.4420 

3.028? 

0. 3243 

2.7568 

0.5000 

3.2105 

0. 3969 

2.8597 

0.5462 

3.3597 

0. 4539 

10 

2.906  2 

0.5eu2 

10 

3.4847 

C. 5000 

3.0200 

O.f  159 

3.5912 

0.5395 

3.0837 

0.6429 

3.6831 

0. 5712 

3.  1394 

0.6663 

3.  7633 

0.5994 

3.18e5 

0.6866 

3.  8340 

0.6240 

15 

3. 2321 

0.7046 

15 

3.  8969 

0.6456 

3.2712 

0.7205 

3.9531 

0. 6647 

3. 3064 

C. 734  7 

4.0037 

0.6819 

3. 3382 

0.7476 

4.0495 

0. 6973 

3.  3672 

0.7592 

4.0912 

0.7112 

20 

3.  3937 

0.7690 

20 

4.  1253 

0.7239 

3.4161 

0.7794 

4.  1642 

0.7355 

3.  4405 

0.7e93 

4.  1965 

0.7462 

3.4612 

0.7964 

4.  2262 

0.7560 

3.  4804 

0.6040 

4. 253? 

0. 765  C 

25 

3.40e.l 

0.9110 

25 

4. 2755 

0.7734 

3.5149 

0.6175 

4. 3034 

0.7812 

3.5305 

0.e235 

4.3256 

0.7895 

3.5451 

0. 8292 

4.  3467 

0.7953 

3.  5588 

0.  6345 

4. 3664 

0.6017 

30 

3.5717 

0. 8395 

30 

4.3849 

0. 9076 
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TABLE  2 
(Continued) 


N = 6 N = 7 


s 

VALUE 

THRESHOLD 

S 

VALCE 

THRESHC ID 

0.  5000 

0.0 

0.  5 0 CO 

C.  0 

1.0000 

0.0 

1.0000 

0.0 

1.5C00 

0.0 

1.  5 0 CO 

O.C 

2.0000 

0.0 

2.0000 

0.0 

5 

2.500C 

0.0 

5 

2.  5000 

0.0 

3.0  )00 

0.0 

3.0000 

0.0 

3.  3203 

0.  1996 

3.5000 

0.  0 

3.5712 

0. 2916 

3.  8364 

0.  1797 

3.  7756 

0. 3607 

4.  1064 

0.2653 

10 

3 . 9 it  6 2 

0. 4158 

10 

4.  3303 

0.3308 

4. 0912 

C.4615 

4.5  155 

0. 3841 

4.2162 

0.5000 

4.  68  3 1 

0. 4288 

4. 3252 

0.5331 

4.8252 

0. 4669 

4.4212 

0. 56TS 

4.  9502 

0.5000 

15 

4.5064 

0. 5871 

15 

5.0611 

0.5290 

4. 5626 

0.6096 

5.  1603 

0.5547 

4.6512 

0.6296 

5.2495 

9.5776 

4.7133 

0.6476 

5. 3302 

O.5S02 

4. 7698 

0. 6639 

5.4036 

0. 6168 

20 

4.8216 

0.6787 

20 

5.4707 

0.6337 

4.8688 

0.6922 

5.5322 

0.6492 

4.  9125 

0. 7046 

5.5889 

0. 6634 

4.9628 

0.7160 

5.6412 

0.6764 

4.99C2 

0.7266 

5.6898 

J. 6894 

25 

5.0249 

0.7363 

25 

5.7349 

0.6996 

5.0573 

0.7454 

5.7765 

0.7099 

5.0876 

0.7539 

5.8163 

0.7196 

5. 1 160 

0.7618 

5.8531 

9.7296 

5.  1426 

0.7692 

5.8976 

0.7371 

30 

5. 1677 

0.7762 

30 

5.9201 

0.7459 
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TABLE  2 
(Continued) 


N = 

_8 

N = 9 

£ 

VALUE 

THRESHOLD 

5 

VALCE 

THRESHOLD 

0.5000 

0.  0 

0.5000 

0.0 

1.0000 

0.0 

1.0000 

3.0 

1.5000 

0.0 

1.5000 

0.0 

2.0000 

0.0 

2.0000 

0.0 

5 

2.5000 

0.0 

5 

2.5000 

0.0 

3.0000 

0.0 

3.0000 

0.0 

3.  5000 

0.0 

3.5000 

0.0 

4.0000 

0.0 

4.0000 

0.0 

U.3tt$e 

0.  1636 

4.50C0 

0.0 

10 

*♦.6360 

0.2435 

10 

4. 8611 

0.  1502 

4.8770 

0.3057 

5.  1613 

0.2251 

5.0837 

0.  3571 

5.4174 

0.2843 

5.2633 

0.4006 

5.6394 

0. 3317 

5.4212 

0. 4381 

5. 8340 

0.3760 

15 

5.5611 

0. 4710 

15 

6.0064 

0.4129 

5.6661 

0.5000 

6.  1603 

0.4453 

5.7985 

0.5259 

6.  2985 

0.4741 

5.9002 

0.5491 

6.4235 

0.5000 

5.9926 

0.5700 

6.  5371 

0.5233 

20 

6.0771 

0. 5891 

20 

6.6409 

0. 5445 

6.1545 

0.6064 

6.7360 

0.5638 

6.2258 

0.6223 

6. 8236 

0.5ei5 

6.2917 

0.6370 

6.9045 

0.5977 

6. 3528 

0.6535 

6.9795 

0.6128 

25 

*.4096 

0.6630 

25 

7.0492 

0.6267 

6.4625 

0.6747 

7.  1 14  1 

0.6396 

6.5119 

0.6855 

7. 1748 

0.6516 

6.5582 

0. 6957 

7.2316 

0.6629 

6.6017 

0.  7052 

7.2850 

0.6734 

30 

6.6426 

0.7141 

30 

7.  3351 

0.6833 
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sequential  decisions  faced  by  any  commander  take  a form 
similar  to  that  of  Moser's  Game,  although  realistic  con- 
siderations produce  considerable  complexities.  Nevertheless, 
an  understanding  of  the  generalized  Moser  Game  is  useful  as 
a basis  for  deducing  an  optimal  engagement  strategy. 
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